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ABSTRACT 


Research  results  obtained  under  the  grant  are  summarized.  Con. 
tributions  to  periodic  control  include:  theory,  computational  methods  and 
applications  to  aircraft  cruise.  The  theory  centers  around  necessary  or 
sufficient  conditions  for  optimality  and  gives  information  on  whether  or 
not  periodic  operation  of  a  dynamic  system  gives  better  performance  than 
steady- state  operation.  The  treatment  is  comprehensive  and  includes  new 
second- order  conditions  which  have  simplified  assumptions  and  incorporate 
control  constraints.  Some  of  these  results  follow  from  a  new  approach 
to  the  derivation  of  higher-order  necessary  conditions.  The  approach 
doesn't  require  normality  assumptions  and  has  provided  other  new  results, 
including  second-order  necessary  conditions  in  optimal  control.  A  method 
for  computing  periodic  optima  is  described.  It  addresses  difficulties 
observed  in  other  approaches  and  has  proved  effiective  in  example  problems. 
Optimal  aircraft  cruise  (specific  range,  endurance,  peak  altitude)  was 
studied  as  an  application  of  theoretical  and  computational  techniques. 

Under  special  circumstances  (e.g.  ,  altitude  constraints,  low  wing  loading 
and  drag,  high  thrust  limits),  it  appears  that  periodic  cruise  is  signifi¬ 
cantly  better  than  steady- state  cruise.  Some  research  was  also  done  on 
the  theory  of  nonlinear  systems.  It  includes:  functional  expansions  for 
input-output  maps,  conditions  for  realizability,  a  backward  shift  approach 
to  internally  bilinear  realizations  and  canonical  forms  for  minimal-order 

realizations  of  two-power  input-output  maps. 
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INTRODUCTION 


Many  dynamic  systems,  such  as  jet  engines  and  aircraft  in  cruise, 
are  operated  in  an  optimum  steady- state  mode.  Sometimes  it  is  possible  to 
improve  the  performance  of  these  systems  still  further  by  using  time- 
dependent  periodic  controls.  Such  improvement  is  based  on  the  exploitation 
of  system  nonlinearities  which  are  only  active  when  the  system  is  in  motion. 
The  first  examples  of  improvement  were  noted  in  the  field  of  chemical 
process  control.  This  led  to  the  first  paper  on  optimal  periodic  control 
[a]  and  a  subsequent,  rapid  development  of  a  general  theory.  See 
[b,c,d]  for  surveys  of  the  theoretical  results  through  1975.  Early 
applications  to  vehicle  and  aircraft  cruise  appear  in  [e,f,  g]  . 

This  report  describes  research  which  was  carried  out  over  the 
period  October  1,  1976  to  January  31,  1982  under  AFOSR  Grant  Number 
77-3158.  The  original  objectives  of  this  grant  were  to  study  the  theory  of 
periodic  control  and  develop  methods  for  the  computation  of  periodic  optima. 
Considerable  progress  has  been  made  in  these  directions.  In  addition,  the 
investigations  have  led  into  several  other  areas.  The  most  important  of 
these  are  optimization  and  nonlinear  systems.  The  Bibliography  gives  a 
chronological  listing  of  journal  articles,  conference  papers,  articles 
submitted  for  publication  and  articles  in  preparation.  In  the  sections 
which  follow,  these  contributions  are  reviewed.  The  emphasis  is  on  a 
general  description  of  the  results  and  their  relation  to  applications  and 
prior  research.  For  the  items  still  in  preparation,  a  somewhat  more 


detailed  account  is  given, 


Personnel  associated  with  the  research  effort  included:  Elmer  G. 

Gilbert  (principal  investigator);  Arthur  E.  Frazho  (post-doctoral  researcher, 

1976-1978),  Daniel  T.  Lyons  (PhD  student,  1976-1980),  Dennis  S.  Bernstein 

(PhD  student,  1977-1982).  The  activities  carried  out  by  Lyons  and  Bernstein 

contributed  significantly  to  their  PhD  degrees  (see  items  [  15,22]  of  the 

Bibliography).  The  papers  [3,4]  received  the  O.  H.  Schuck  Award  of  the 

American  Automatic  Control  Council  for  the  best  contribution  at  the  1977 

Joint  Automatic  Control  Conference.  The  journal  article  [6]  received 

special  recognition  by  the  IEEE  Control  Systems  Society. 

There  have  been  a  number  of  interactions  with  the  professional  and 

academic  community.  Spoken  papers  include  items  [  1,  2,  3,4,  7,  8,  11,  12,  13, 

17,  18,  19]  and  a  presentation  by  Gilbert  at  the  1979  Optimization  Days 

Conference  in  Montreal.  Seminars  were  presented  by  Gilbert  at  the 

» 

following  universities:  Michigan,  Minnesota,  Purdue,  Washington  (St.  Louis), 
Rochester,  Johns  Hopkins.  Several  conversations  were  held  with  Jason  L. 
Speyer  who  has  been  concerned  with  aircraft  cruise  and  the  computation  of 
periodic  optima.  At  the  December  1981  Conference  on  Decision  and  Control 
Gilbert  participated  in  an  informal  meeting  of  researchers  working  in 
periodic  control  (J.  Speyer,  P.  Dorato,  S.  Bittanti,  R.  Evans,  D. 
Rodabaugh).  Presently,  there  is  a  study  of  periodic  aircraft  cruise  at  the 
Lockheed- California  Company.  Researchers  there  (E.  Shapiro  and  D. 
Rodabaugh)  have  been  motivated  by  work  done  under  this  grant  [  13,  15,  18]  , 
and  are  trying  to  extend  it  to  specific  aircraft.  They  have  been  in  touch 


with  both  Gilbert  and  Lyons. 


THEORY  OF  PERIODIC  CONTROL 

A  general  formulation  for  an  optimal  periodic  control  problem 
(OPC)  is: 

(1)  x(t)  =  f(x(t),u(t))  ,  t  e  [  0,t]  , 

(2)  u(t)  e  U  C  Rm,  x(0)  =  x(t)  e  Rn  ,  T  e  (0,  T  ]  c  R  , 

.  T  _ 

(3)  y  =  ±  J  f(x(t),u(t))  dt  £  R  , 

o 

(4)  g.(y)  <  0  ,  i  =  -  j . -1  , 

g.(y)  =  0  ,  i  =  1, . . . .  k  , 

(5)  J  =  go(y)  . 

Here  ( 1)  describes  the  dynamic  system  and  (2)  gives  the  constraints.  The 

vector  y  is  the  average  over  the  period  r  of  the  quantities  of  interest, 
f  (x(t),u(t)),  in  the  optimization  problem.  The  objective  is  to  minimize  J 
by  choice  of  u(  •  ),x(« )  and  r  subject  to  the  additional  constraints  (4). 

The  related  optimal  steady- state  problem  (OSS)  is  obtained  when 
x(* )  and  u(* )  are  assumed  to  be  constant: 

(6)  0  =  f(x,u)  , 

(7)  u  €  U  ,  x  €  Rn  , 

(8)  y  =  f  (x,u)  . 

As  in  OPC  the  cost  and  additional  constraints  are  given  by  (4)  and  (5).  The 
problem  OSS  is  simpler  than  OPC  because  it  is  finite- dimensional.  Since  OSS 
is  a  specialization  of  OPC  it  may  happen  that  OPC  yields  a  lower  cost  than 
the  optimal  cost  in  OSS.  When  this  does  happen  it  is  said  that  OPC  is 


proper. 


Much  of  the  early  literature  (see  [b,c,d]  )  concerns  necessary 


conditions  for  optimality  in  OPC  and  OSS  and  tests  for  proper.  The 
portion  of  this  research  area  related  to  first-order  necessary  conditions 
is  brought  together  in  a  very  general,  unified  treatment  in  [  1 ,5]  .  These 
papers  include:  a  precise  statement  of  necessary  conditions,  a  set  of  tests 
for  proper  (based  on  the  maximum  principle  and  relaxed  controls),  rela¬ 
tionships  between  tests  for  proper  and  a  proof  that  the  set  of  tests  cannot 

•s 

be  made  larger.  Most  of  the  research  for  [1,5]  was  completed  before 
the  grant  began. 

Some  sufficient  conditions  for  steady- state  optimality  in  OPC  are 
given  in  [  10]  .  They  require  that  f(x,u)  =  Ax  +  h(u)  and  that  g.(y)  , 

i  =  -j . k,  and  f(x,u)  satisfy  certain  convexity  assumptions.  Care  is  j 

taken  to  establish  close  connections  to  the  results  of  [  5  ]  .  The  sufficient  J 

conditions  give  some  indication  of  circumstances  under  which  OPC  cannot  ' 

be  proper.  For  example,  OPC  cannot  be  proper  if  the  plant  is  modelled 
by  linear  differential  equations  and  the  cost  functional  is  convex.  This 
underlines  the  importance  of  understanding  the  effects  of  nonlinearities  in 
periodic  control  problems. 

One  approach  to  a  fuller  understanding  of  the  nonlinearities  is 

! 

second-order  theory.  As  first  shown  in  [h]  this  leads  to  frequency- domain  j 

t 

conditions  called  II  tests.  The  paper  [14]  makes  three  contributions  in 
this  direction:  (1)  it  gives  a  II  test  for  OPC,  which  is  a  more  general 
problem  than  the  one  considered  in  [h]  ,  (2)  it  shows  that  "normality" 


f 


i 


explores  fully  the  relationships  between  necessary  and  sufficient  con¬ 
ditions  for  optimality  in  OSS  and  OPC.  With  respect  to  (3),  the  attack  is 
similar  in  spirit  to  the  treatment  of  first-order  conditions  presented  in  [  5  ]  . 

The  results  in  [  14  ]  have  two  limitations:  they  require  normality 
conditions  which  may  be  difficult  to  verify  or  may  not  be  satisfied,  and  the 
control  set  U  must  be  open.  The  latter  limitation  is  troublesome  in 
practical  applications  because  optima  often  occur  on  the  boundaries  of 
closed  constraint  sets.  The  investigation  of  the  limitations  (mostly  by 
Bernstein)  led  ultimately  to  a  new  theory  of  higher-order  necessary 
conditions  in  optimization  and  optimal  control.  This  theory  is  reviewed 
in  the  next  section.  A  consequence  of  the  theory  is  a  new  II  test  for  proper. 
This  test  will  be  developed  fully  in  [  23  ]  ;  here,  only  the  test  itself  will  be 
described. 

Let  the  general  notation  and  assumptions  in  [  14]  hold.  Let  U  be 
a  convex  (not  necessarily  open)  set.  Define 

(9)  T  =  {(X,  p,  «)  :  (X.p.a)  €  RnX  R*  X  R^+k+1  satisfies  (10)  >, 

where 

d0)  \  ,  Hy  =  0 

Hu>0,u+U€U  , 
u  — 

tt j  >  0  ,  i=-j,...,0  , 
or^g.  =  0  ,  i=-j . ■  1  i 

(X,|i,  «)  i  0  . 

T  is  the  set  of  multipliers  that  satisfy  the  first-order  necessary  conditions 


~t 


for  optimality  in  OSS.  Notice  that  (10)  becomes  (3.  3)  in  [14]  when  U  is 

A  — 

open.  Define  I  and  I  by 

(11)  I  =  {  1,...  ,k}  ,  T  =  {i  :  i  <  0,  i.  =  0  }  U  {0 . k}  . 

Theorem.  Assume  (x,u)  solves  OSS.  Then  T  is  not  empty. 

Let  x  €  Rn,  u  e  Rm,  and  “  >  »  U  [  J!(A)  satisfy  (3.5) 

of  [14]  and 

(12)  u  +  u  +  Re  n  e  €  U  ,  t  €  [  0,  ]  . 

CO 

Then  if 

(13)  y'H  y  +  x'H  x+2x'H  u  +  u'H  u  +  «#n(w)n<0, 

yy  xx  xu  uu  „  „ 

for  all  (\,  p,  a )  €  r 

OPC  is  proper. 

A  few  comments  are  in  order.  Because  H  ,  H  ,  H  ,  H 

yy  xx  xu  uu 

and  II(a>)  depend  on  (X,p,  a)  the  appearance  of  T  in  (  13)  is  significant. 

Condition  (13)  cannot  hold  if  rj  =  0  (this  is  an  easy  consequence  of  the 

second-order  necessary  conditions  for  optimality  in  OSS).  If  u  is  in  the 

boundary  of  U  ,  it  is  usually  not  possible  to  satisfy  (12)  unless  u  ^  0  . 

If  U  =  Rm  (as  in  [  14]  )  the  choice  ■q^0,u  =  0,x=0,y  =  0  is  possible 

and  II  (co)  <  0  for  all  (\,  p,  a  )  e  r  becomes  a  test  for  proper.  This  is 

like  the  condition  (5.  3)  in  Theorem  5. 1  of  [  14  ]  ,  except  there  T  does  not 

appear.  This  is  because  the  normality  assumption  in  Theorem  5. 1  implies 

T  is  a  single  ray  with  a  >  0  .  Thus  by  setting  a  =  1  ,  (X.p.or)  is 

O'  o 

unique.  The  appearance  of  T  in  (13)  is  the  complication  which  results  from 
the  lack  of  any  normality  assumption  in  the  above  theorem. 


,  -t  v  4  * 


•: '  y  v-'  ‘ 
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When  f(x, u)  and  f(x,u)  are  replaced  respectively  by  f(t,x,u)  and 
f(t,x,u),  OPC  is  changed  drastically.  For  example,  OSS  becomes  much 
more  complicated.  To  maintain  periodicity  it  is  necessary  to  assume  that 
t  is  fixed  and  that  f(t,x,u)  and  f  (t,x,u)  are  periodic  in  t  with  period  t  . 

An  example  of  this  situation  is  the  periodic  cruise  of  a  solar- powered 
aircraft.  Then  t  =  24  hours  and  the  time- dependence  of  f(t,x,u)  and 
f(t,x,u)  accounts  for  the  variation  in  solar  radiation  during  the  day.  Little 
work  has  been  done  on  such  time- dependent  systems. 

The  note  [  17]  concerns  a  class  of  mechanical  systems  which  are 
time- dependent.  The  objective  is  to  extract  energy  from  the  systems  by 
means  of  periodically- varying  applied  forces.  A  characterization  of  the 
optimal  control  is  obtained  and,  when  the  mechanical  system  is  conservative, 
it  takes  on  an  especially  simple  form.  This  leads  to  a  feedback  control  law 
for  mechanizing  a  near  optimal  control.  The  feedback  control  is  a  new 
idea  and  appears  to  have  practical  advantages.  The  research  will  be 
developed  more  fully  in  a  future  paper. 

HIGHER-ORDER  NECESSARY  CONDITIONS  IN  OPTIMIZATION 

The  principal  contribution  of  [  20  ]  is  a  systematic  approach  to 
higher-order  necessary  conditions  in  optimization  theory.  The  approach 
is  based  on  a  very  general,  abstract  optimization  problem:  Minimize 
(e)  subject  to 
(14)  e  €  E  , 


8 


(15)  4>  (e)  <  0  , 

(16)  4»(e)  =  0  , 


where:  £,  is  a  set,  E  C  ,  k  =  positive  integer,  4-  :  £-*7Rk, 
and  ^  are  topological  vector  spaces,  4>0  !  £.  and 

(ji  ;  £  -»■  ^  .  Let  Z  C  and  Z  C  ^  be  closed  convex  cones  with 

nonempty  interior  such  that  Z^  4  and  Z  4  .  If  z,  z  e  ,  then 

z  <  z  means  z  -  z  e  Zq  .  Identical  notation  applies  for  z,z  e  ^  . 

Necessary  conditions  are  derived  for  this  problem  under  weak 
assumptions  on  $  ,<)>,  ij'  and  E»  They  take  the  following  form.  Let 

e  solve  the  optimization  problem.  Denote  the  set  of  bounded  linear  maps 
from^=  X  ^  into  1R  by  .  Then  there  exists  l  =(|^,|^)  e  ^*xT^ 
such  that 


(17)  l  t  0  , 

(18)  vz*’  z*=  <V  3*!VV  z°’Vz,x£} 

(19)  1,  (?  («)  +  Y)  ■  0  , 

<P 

(20)  l  (h)  >  0  ,  h  e  K  . 

In  these  conditions  Y  e  Z  =  Z^  X  Z  is  a  generalized  critical  direction  and 
_  k 

K  C  X  is  a  convex  set  which  is  used  together  with  a  map  9  (defined 

on  a  subset  of  K  into  E)  to  form  a  representation  for  E.  The  necessary 
conditions  and  the  required  assumptions  are  in  the  spirit  of  those  given  by 
Neustadt  [  i ]  ,  but  the  results  are  stronger  and  involve  the  (new)  concept 
of  a  critical  direction. 

By  specializing  E  and  making  assumptions  on  the  differentiability 
of  <j>o  ,  4>  and  i(;  conditions  (17)  -  (20)  lead  to  necessary  conditions  of 


9 


arbitrary  order.  In  particular,  Y  and  K  are  related  respectively 

to  the  intermediate-order  and  highest-order  terms  in  a  series  expansion 

of  the  functions  &  ,  <b  and  ib  • 

o 

One  set  of  results  concerns  first-  and  second-order  necessary 

conditions  when  Sis  a  subset  of  a  vector  space  and  <j>Q  ,  4>  and  4*  have 

directional  differentials.  The  second-order  results  generalize  necessary 

conditions  due  to  Warga  (Theorem  2.  3  of  [j]  )  in  the  following  ways:  The 

optimization  problem  is  more  general,  the  hypotheses  are  weaker  and  a 

normality  assumption  is  not  required.  Another  set  of  results  concerns  first-  , 

second-  and  third-order  necessary  conditions  when  &  is  a  Banach  space  and 

,  c|>  and  i|j  have  Frechet  derivatives  of  appropriate  order.  While  similar 

conditions  of  first-  and  second-order  have  appeared  previously,  the  third- 

order  conditions  appear  to  be  new. 

The  lack  of  normality  assumptions  in  all  of  the  above  results  means 

that  the  multipliers  (e.  g.  ,  (  l  ,i  )  in  (17)  -  (20))  are  not  necessarily 

9  4*  ^ 

unique.  This  brings  up  interesting  questions  which  are  explored  at  length 
in  [21,22]  . 

The  paper  [21  ]  applies  the  preceding  theory  to  the  following  problem 
in  optimal  control:  minimize  J(x(«),u(*))  subject  to 

(21)  J(x(*),u(*))  =  <t>0{x(t1),x(t2))  , 

(22)  ^Wt^.xttj))  <  0  ,  i  =  1 . j  , 

(23)  i|i(x(t1)>x(t2))  =  0  , 

(24)  x(t)  =  f(t,x(t),u(t))  ,  te  [  tj,t2  ]  . 
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m 


Here  x(t)  €  R  ”  ,  u(t)  €  U  q  C  ^  m  ,  f:  xlR,  °  X  ^  m  -►If^  n, 

<j>.  :KnxRn^K  and  4<  :Rinx|Rvn-*Rsk  .  Under  suitable 
assumptions  onf  ,  <j>  and  4>  and  the  class  of  control  functions,  second- 
order  necessary  conditions  for  optimality  are  derived  and  expressed 
concisely  in  terms  of  Lagrangian  and  Hamiltonian  functions  and  a  multiplier- 
free  characterization  of  admissible  variations  .  The  optimal  control  problem 
is  more  general  than  problems  considered  previously  [  k,  l  ]  in  the  rigorous 
derivation  of  second-order  necessary  conditions.  Unlike  [k,i  ]  normality 
assumptions  are  not  required.  This  leads  to  an  unusual  min-max  formula¬ 
tion  of  an  accessory  minimum  problem.  A  number  of  questions  concerning 
normality  and  regularity  (uniqueness  of  multipliers)  occur  and  are  examined. 
The  new  necessary  conditions  should  be  useful  in  a  variety  of  applications 
involving  optimal  control.  The  generalized  II  test  described  in  the  pre¬ 
ceding  section  is  an  example. 

The  necessary  conditions  of  the  preceding  paragraph  are  based  on 
"weak"  variations.  The  same  approach  can  be  applied  to  relaxed  controls 
[  j  ]  .  Under  suitable  assumptions  this  gives  a  new  second-order  necessary 
condition  for  ordinary  controls.  See  Theorem  6.  3  of  [  21]  . 

COMPUTATIONAL  METHODS 


The  computation  of  solutions  of  OPC  is  difficult.  This  has  been 
observed  by  Speyer  and  his  coworkers  [e,m,n]  and  by  Lyons  in  his  first 
attempts  to  optimize  aircraft  cruise.  The  computational  use  of  necessary 


conditions  seems  particulary  hazardous  in  view  of  [m,n]  .  There  it 
is  shown  that  the  necessary  conditions  may  have  rich  families  of  solutions. 
Thus ,  there  is  a  good  chance  that  computational  algorithms  may  yield 
a  solution  of  the  necessary  conditions  which  is  not  a  solution  of  OPC. 
Another  approach  is  to  use  a  gradient  descent  algorithm  in  the  space  of 
controls.  But  then  it  is  difficult  to  satisfy  the  periodicity  constraint 
x(0)  =  x(t)  precisely. 

The  following  approach  addresses  these  difficulties  and  has  proved 
to  be  effective.  The  state  function  x(t)  is  represented  by  a  (vector) 
polynomial  spline  function.  The  periodicity  constraint  is  satisfied  exactly 
by  making  the  spline  function  periodic.  This  establishes  a  one-to-one 
correspondence  between  the  spline  and  the  values  of  the  spline  at  its 
joints.  The  differential  equation  (1)  is  solved  by  choice  of  the  control 
function  u(t).  This  step  requires  that  f  has  a  special  structure  so  when  x(t) 
is  given  there  exists  a  u(t)  which  solves  (1).  Fortunately,  the  structure 
is  often  present.  For  example,  suppose  x(t)  =  (S(t),V(t))  where 
S(t),V(t)  e  ^  and  (1)  can  be  written 

(25)  S(t)  =  V(t)  ,  V(t)  =  F(S(t),  V(t))  +  u(t)  . 

Then  if  S(t)  is  a  twice-differentiable  periodic  spline  the  (periodic)  control 
which  solves  the  differential  equation  is  given  by 

(26)  u(t)  =  S(t)  -  F(S(t) ,  S(t))  . 

Once  x(t)  and  u(t)  are  known,  the  integral  in  (3)  is  evaluated  by  an  accurate 
quadrature  formula  such  as  Simpson's  rule.  Control  constraints  and  the 


constraints  (4)  are  incorporated  by  means  of  penalty  functions.  The 
resulting  optimization  problem  is  finite- dimensional  because  all  the  data 
(x(t),u(t),  y,  g^,y  )  are  determined  by  the  values  of  the  spline  at  its  joints. 

The  approach  just  described  has  proved  to  be  effective  in  applications 
such  as  those  in  the  next  section  (see  [13 ,15,18  ]  ).  Its  advantages  include: 
exact  satisfaction  of  the  periodicity  constraint,  an  exact  solution  of  the 
differential  equation  (1),  control  of  the  smoothness  of  x(t)  by  selecting  the 
type  of  spline  and  the  location  of  its  joints ,  simple  formulas  for  computing  the 
penalized  cost  and  its  derivatives  with  respect  to  the  joint  values  and  an 

efficient  start-up  procedures  for  the  minimization  algorithm  when  the  j 

spline  has  many  joints.  Simple  problems  have  been  solved  by  minimi¬ 
zation  algorithms  which  use  only  the  values  of  the  penalized  cost.  More  complex 
problems  with  difficult  constraints  require  gradient  descent  algorithms 
and  an  augmented  Lagrangian  approach  for  the  penalty  terms. 

AIRCRAFT  CRUISE 

For  many  years  it  was  assumed  that  fuel-optimal  aircraft  cruise 
was  steady- state.  This  belief  was  debated  in  a  series  of  papers  in  the 
early  1970's  (see  [e,g]  for  references  and  comment).  Using  techniques 
from  the  theory  of  optimal  control,  Speyer  [e]  gave  evidence  that 
steady-state  cruise  is  not  necessarily  optimal.  This  evidence  was 
supported  by  the  work  of  Gilbert  and  Parsons  [g]  who  modelled  aircraft 
cruise  as  a  problem  in  periodic  control.  Using  the  energy- state  model  j . 

for  aircraft  motion  and  the  idea  of  relaxed  steady-state  control  [  5,b,c,d]  ,  I 
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they  showed  that  time- dependent  periodic  control  increases  the  specific 
range  for  the  F-4  aircraft  and  a  class  of  subsonic  aircraft  models. 
Unfortunately,  the  results  of  these  papers  are  not  totally  convincing. 

In  [  e  ]  the  improvements  are  small  and  in  [  g  ]  the  required  "chattering" 
controls  can  only  be  approximated  by  physically  realistic  controls. 

This  was  the  state  of  affairs  when  research  under  the  grant  began. 
Since  then,  considerable  progress  has  been  made.  Results  on  the  improve¬ 
ment  of  specific  range  have  appeared  in  [13,18]  .  The  PhD  dissertation 
[15]  includes  additional  results,  some  of  which  will  appear  in  [ 24  ]  . 

The  following  paragraphs  give  a  brief  summary  of  the  work  which  has  beei 
done.  Significant  improvements  in  cruise  performance  appear  feasible 
in  certain  specialized  situations. 

Three  aircraft  cruise  problems  have  been  studied:  maximum 
specific  range,  maximum  endurance  and  maximum  peak  altitude.  In  all 
three  problems  the  same  point-mass  model  is  used.  In  it  range  is  the 
independent  variable.  The  controls  are  lift  and  thrust  and  the  state  variables 
are  altitude,  velocity  and  flight- path  angle.  The  basic  assumptions  are: 

a  classical  subsonic  lift-drag  relation,  an  exponential  atmospheric  density, 
constant  thrust- specific  fuel  consumption,  limits  on  altitude  and  engine 
thrust.  This  model  captures  the  essential  nonlinearities  and  dynamics  and 
is  much  more  realistic  than  the  energy- state  model.  The  model  is 
characterized  by  three  nondimensional  parameters:  6  =  ^  minimum 
lift-to-drag  ratio,  p  =  constant  X  (wing  loading)”*  X  (air  density  at 
reference  altitude)”*,  Tm  =  (maximum  engine  thrust)  X  (engine  thrust  for 
optimal  steady- state  cruise  at  reference  altitude)"*  . 


In  all  three  problems  both  analytical  and  computational  approaches 
are  used.  The  analytical  studies  involve  simplifications  of  the  model  and 
employ  generalizations  of  methods  from  periodic  control  (relaxed- controls , 
quasi- steady- state  controls,  frequency  response);  the  objective  is  to 
estimate  the  effects  of  parameter  change  and  give  insight  into  the  mechanisms 
which  cause  improvement.  In  the  computational  studies  optimal  periodic 
trajectories  are  determined  without  making  any  simplifications  of  the 
model.  A  number  of  solutions  for  different  values  of  the  key  parameters 
are  obtained.  Thus,  performance  trends  are  established. 

In  the  specific  range  problem  a  constraint  on  the  maximum  altitude 

is  necessary  if  improvements  in  cruise  are  to  occur.  Under  the  best 

conditions  (6  <  .05,  fl  <  .05,  T  >  8  ,  reference  altitude  =  maximum 
~  —  m  — 

altitude)  fuel  consumption  can  be  reduced  by  more  than  25%.  Optimal 
periodic  cruise  requires  (approximately)  a  maximum- range  glide  followed 
by  a  transition  to  a  fuel- efficient,  full-thrust  climb  which  recovers  the  altitude 
lost  in  the  glide.  The  periodic  cruise  is  better  than  optimal  steady- state 
cruise  because  thrusting  takes  place  at  high  speeds  where  energy  addition 
is  most  efficient. 

In  the  endurance  problem  a  constraint  on  the  minimum  altitude  is 
essential  for  improvement.  Under  the  best  conditions  (6  <  .05,  p  <  .04, 

Tm  >  8,  reference  altitude  =  minimum  altitude)  fuel  consumption  can  be 
reduced  by  more  than  32%.  The  form  of  the  optimal  trajectory  is  (approx¬ 
imately)  a  minimum- rate-of-descent  glide  followed  by  a  transition  to  a 
maximum- rate. of-ascent  climb. 


f 

The  maximization  of  peak  altitude  is  not  a  special  case  of  OPC. 

Thus  ad  hoc  techniques,  somewhat  similar  to  those  used  for  the  range 
and  endurance  problems,  must  be  used.  The  results  obtained  are  less 
complete  and  additional  physical  considerations  appear.  For  example, 
the  dynamic  pressure  at  peak  altitude  must  be  constrained.  Otherwise, 
aerodynamic  control  would  be  lost  at  peak  altitude.  An  upper  bound  on 
the  peak  altitude  is  the  loft  ceiling.  Realistic  periodic  cruise  trajectories 
which  approach  this  altitude  have  been  obtained. 

Another,  more  complex  problem  in  periodic  flight  was  also 
investigated.  Part  of  the  motivation  was  to  test  further  the  computational 
techniques  of  the  previous  section.  The  problem  concerns  the  motion  of 
a  gliding  aircraft  in  a  horizontal  wind  with  vertical  shear.  Observations 
of  bird  flight  suggest  that  it  should  be  possible  (by  periodic  flight)  to 
extract  energy  from  the  wind  shear  and  stay  aloft  despite  drag  losses. 

Analyses  [o,  p]  based  on  crude  models  of  motion  verify  this  possibility, 
but  computational  efforts  on  realistic  models  have  not  been  undertaken. 

A  reasonably  good  model  [  o  ]  for  flight  through  wind  shear  is 

(27)  V  =  «  V  W  sin  y  cos  y  cos  p  .  -  sin  y 

O  i 

(28)  y  ~  W  sin  y  cos  p  +  CT  V  coevji  -  V”1  cos  y 

Xa 

(29)  p  =  W  tan  y  sin  p  +  C  V(cos  y)"*  sin  ib 

i-f  I 

(30)  CD  =  CD  +  K  CL2  ,  I 

O  I 


p  =  heading  angle,  Cp  =  drag  coefficient,  =  lift  coefficient,  4«  =  bank 

angle,  W  =  wind  shear  (constant),  K  =  .  02  and  =  .03.  An  optimal 

o 

periodic  control  problem  is  formed  by  defining  the  cost 
,  t 

(31)  J  =  -  -  /  V  sin  y  dt  =  average  rate  of  descent  . 

T  0 

If  min  J  <  0  ,  it  is  certainly  possible  to  maintain  altitude. 

The  problem  (27)  -  (31)  was  solved  by  the  method  of  the  previous 
section.  The  state  variables  V,  y>  P  were  specified  by  periodic  cubic  V 

splines  and  the  equations  of  motion  (27)  -  (29)  satisfied  by  selecting  the 
controls  C_.  ,  CT  ,  i|j  .  The  control  constraint  (30)  was  implemented  by 

iJ  J-J 

a  penalty  function  approach.  The  gradient  of  J  with  respect  to  the  spline 

values  at  the  knots  was  computed;  the  implementation  employed  basis 

splines  and  was  quite  efficient.  The  resulting  finite-dimensional  1 

problem  (dimension  =  15  and  30)  was  solved  numerically  by  a  standard  | 

quoisi-Newton  algorithm.  Convergence  tended  to  be  slow  and  was  probably 

caused  by  the  penalty  function  implementation  of  (30). 

The  first  computations  were  for  a  single  period  (t  =  10)  and 
W  =  .25,  .5  ,  1.0.  They  all  gave  physically  realistic  trajectories  with 
J  <  0.  Later  computations  with  longer  periods  led  to  better  values  for 
J,  but  the  trajectories  were  physically  unrealistic.  Multiple  local  minima 
were  also  discovered.  Additional  work  will  be  done  in  the  future  and 


reported  in  a  paper. 


NONLINEAR  SYSTEMS  THEORY 


The  research  on  nonlinear  systems  theory  grew  out  of  attempts 
to  express  the  periodic  solutions  of  (1)  by  means  of  a  functional  series, 
similar  in  form  to  a  Volterra  series.  The  objective  was  to  obtain  new 
conditions  and  tests  for  optimality  which  were  of  order  two  and  higher. 

A  variational  series  approach  proved  to  be  effective  and  was  instrumental 
in  developing  ideas  which  helped  lead  to  some  of  the  results  outlined  in 
the  preceding  sections  [  14,20,21  ]  .  The  consequences  in  the  area  of 
nonlinear  systems  theory  are  now  described.  Applications  by  other 
researchers  can  be  found  in  the  literature  (see,  e.  g.  ,  [  q,  r]  ). 

The  papers  [4,  6]  develop  the  general  theory  of  variational  series 
and  apply  it  to  the  derivation  of  Volterra  series  and  Volterra- like  series 
for  the  input-output  maps  of  nonlinear  differential  systems.  There  are 
a  number  of  advantages  over  the  Carleman  technique  proposed  earlier  by 
Brockett  and  Krener  (see,  e.  g.  ,  [  s  ]  ).  The  approach  also  extends  to 
many  other  types  of  dynamical  systems,  including  discrete-time  systems. 

These  ideas  are  carried  further  in  [  3,9].  By  observing  the 
form  of  the  second-order  terms  in  the  variational  series  for  the  dynamical 
system  is  easy  to  obtain  necessary  and  sufficient  conditions  for  the 
realizability  of  input-output  maps  as  finite-dimensional,  nonlinear  dynamical 
'ystems  (both  continuous- time  and  discrete-time).  The  more  involved 
algebraic  approach  of  the  earlier  literature  (e.  g.  ,[t,u]  )  is  avoided. 

Another  application  of  [  6  ]  is  given  in[  19  ]  .  It  elaborates  and 
combines  results  in  earlier  conference  papers  [2,12].  The  structural 


representation  in  [  6]  is  modified  to  obtain  a  class  of  minimal-order 
realizations  for  continuous -time,  two-power,  input-output  maps.  Further 
developments  describe  the  entire  class  of  realizations,  show  how  they 
are  connected  to  the  class  of  realizable  symmetric  Volterra  transfer 
functions  and  give  a  simple  canonical  form  for  the  (equivalence)  class  of 
minimal-order  realizations.  A  theory  of  minimal  realizations  for 
internally  bilinear  systems  was  known  before  [v]  ;  but  [2]  is  believed 
to  be  the  first  published  result  for  a  general  class  of  nonlinear  systems. 
Crouch  [  w)  has  obtained  deep  results  for  a  general  class  of  nonlinear 
systems  with  polynomial  input-output  maps.  For  the  (special)  two-power 
case,  the  details  in  [  19  ]  are  more  general  and  complete. 

In  1976  Frazho  had  been  working  on  the  use  of  restricted  backward 
shift  realizations  in  the  theory  of  linear  systems.  He  and  Gilbert  saw  that 
this  formalism  provided  an  alternative  view  for  the  theory  and  realization 
of  internally  bilinear  dynamical  systems.  Gilbert  discusses  the 
formalism  and  applies  it  to  linear  systems  in  [8]  .  He  also  describes  how 
to  obtain  a  simple  characterization  for  the  class  of  partial  realizations. 

In  [7,  11,  16]  Frazho  developes  an  elegant  statement  of  the  theory  for  the 
nonlinear  problem.  W.  J.  Rugh  was  aware  of  this  research  in  its  early 
stages  and  has  incorporated  modification  of  it  in  his  recent  book  [  r  ]  on 
nonlinear  systems  theory.  Extensions  to  systems  which  are  internally 
state-affine  have  been  published  recently  by  Frazho  [x]  . 


SENSITIVITY  OF  CHARACTERISTIC  ROOTS 


The  research  described  in  this  section  is  not  connected  to  the  other 
research  done  under  the  grant.  It  was  motivated  by  a  conversation  with 
Dr.  E.  Shapiro  of  the  Lockheed- California  Company.  He  observed  that, 

whatever  the  design  approach,  good  antopilot  systems  often  have  an  j 

interesting  property:  the  eigenvectors  of  the  linear  closed-loop  system 

are  (approximately)  mutually  orthogonal.  He  wondered  if  there  was  some 

unknown,  underlying  reason.  Gilbert  arrived  at  a  possible  explanation 

based  on  the  sensitivity  of  characteristic  roots.  A  paper  on  this  work  is 

being  prepared  [25  ]  .  The  following  is  a  brief  review  of  the  main  results. 

Let  A  be  an  n  by  n  real  matrix  and  let  X.(A)  be  a  real  characteristic  | 

root  of  A.  If  X.(A)  is  distinct,  X^(A)  is  a  continuously  differentiable 

function  of  a.,  ,  j,  k  =  1, . . .  ,  n,  the  elements  of  A.  There  are  formulas 

jk  ! 

2 

for  the  n  first  partial  derivatives  of  X^(A).  Let  the  n  by  n  matrix  of  j 

these  partial  derivatives  by  given  by  j 

(32)  Si  = 

and  let  v.,  e  R°  satisfy  the  conditions  (prime  denotes  transpose) 


ax. 

l 


(33)  A  v.  =  X.v.  ,  A'  w.  =  X.w.  ,  v. 'w.  =  1  ,  v. '  v.  =  1  . 

l  ii  l  ii  ii  ii 

Such  vectors  are  known  to  exist  and  (Jacobi's  formula  [y]  ) 


(34)  =  w^ '  v^ 


Since  has  n  elements  it  is  an  overly  elaborate  characterization 
for  measuring  root  sensitivity  in  design.  If  A  is  not  sparce  and  all  of 
its  elements  are  subject  to  variations,  the  (Euclidean)  norm  of  is  a 
good  (scalar)  measure  for  root  sensitivity.  Let  it  be  given  by 


How  can  -*J  be  made  small  by  the  choice  of  A?  This  question  comes 
up  in  design  because  the  close- loop  matrix  A  depends  on  choice  of  the 
control  law. 

The  minimization  of  ^  .  over  the  a.,  has  a  simple  answer: 

1  jk  r 

^  .(A)  >  1  for  all  A  and  -J^(A)  =  1  if  and  only  if  the  eigenvector  v.  is 
orthogonal  to  all  other  eigenvectors  of  A.  Though  the  proofs  are  more 
involved,  similar  results  have  been  derived  when  X  .  is  complex 
(X.  =  o\  +  *y -lw.  ,  o\  e  R).  For  example, 

(36)  = 


So¬ 


da 


jk 


satisfies 


4T 


i  — 


and 


2,'- 


■rr 


if  and  only  if  the  (complex) 


eigenvectors  corresponding  to  the  characteristic  roots  <r  ^  _+  s/-l ' 
are  orthogonal  to  all  other  eigenvectors  of  A.  Analgous  results  have 

/— r~  r 

V  w.  +  <T  . 


been  obtained  for  the  sensitivities  of  w.  and 


If  all  root  sensitivites  are  made  minimal,  the  mutual  orthogonality 


of  eigenvectors  mentioned  in  the  beginning  paragraph  of  this  section 
occurs.  This  suggests  that  root  sensitivity  may  have  been  an  underlying 
objective  in  the  autopilot  designs.  The  above  results  may  lead  to  a  design 
procedure  for  multivariable  systems  when  root  sensitivity  is  incorporated 
directly.  For  example,  the  sensitivity  requirements  could  be  achieved 
by  state  feedback  using  eigenvector  placement  techniques  [z  J  . 
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